💻 Local LLMs

Model Quantization, Inference Optimization, GGUF Format, Privacy-preserving AI

Feeds to Scour
SubscribedAll
Scoured 4977 posts in 592.7 ms
is this legit? Supposedly LangVAE straps a VAE + compression algorithm onto any LLM image, reduces resource requirements by up to...
arxiv.org·3d·
Discuss: r/LocalLLaMA
📱Edge AI
Preview
Report Post
Running Local LLMs in Game Engines - Here's My Journey with Godot + Ollama
dev.to·8h·
Discuss: DEV
☁️Serverless Rust
Preview
Report Post
From Online Profile Paranoia to AI Complacency: Have We Really Stopped Caring About Privacy?
metamood.ai·1d
🏠Self-hosted AI
Preview
Report Post
Show HN: Why is ML inference still so ad-hoc in practice?
news.ycombinator.com·1d·
Discuss: Hacker News
🚀MLOps
Preview
Report Post
Introducing the XLab AI Security Guide
lesswrong.com·5h
🛡️Computer Security
Preview
Report Post
Yann LeCun’s VL-JEPA: The breakthrough that gives AI a "Mind's Eye" (instead of just a mouth).
hisohan.substack.com·4h·
Discuss: Substack
📱Edge AI
Preview
Report Post
GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMs
arxiv.org·2d
🏠Self-hosted AI
Preview
Report Post
The Transformer Architecture: A Deep Dive into How LLMs Actually Work
dev.to·2h·
Discuss: DEV
🤖Transformers
Preview
Report Post
A Linux User’s Approach to Local, Privacy-Respecting Image Editing using Local AI Model
reddit.com·1d·
Discuss: r/linux
🏠Self-hosted AI
Preview
Report Post
vagos/llm-grep: Match lines using both classic and semantic regular expressions with LLM.
github.com·1d·
Discuss: Lobsters
📝NLP
Preview
Report Post
Real Time Detection and Quantitative Analysis of Spurious Forgetting in Continual Learning
arxiv.org·2d
📝Parser Combinators
Preview
Report Post
Study: Shrinking AI memory boosts accuracy
ed.ac.uk·3d·
Discuss: Hacker News
📱Edge AI
Preview
Report Post
TRUNAJOD: A text complexity library for text analysis built on spaCy — TRUNAJOD 0.1.1 documentation
trunajod20.readthedocs.io·7h
📝NLP
Preview
Report Post
TrafficLLM: Why LLMs Are Becoming Essential for Encrypted Network Traffic Analysis
dev.to·14h·
Discuss: DEV
🏠Self-hosted AI
Preview
Report Post
How To Use LLM-Powered Coding Assistants Safely: Risks & Best Practices
xebia.com·9h·
Discuss: Hacker News
🤖AI Coding Tools
Preview
Report Post
Book Review: Why Machines Learn
philippdubach.com·22h·
Discuss: Hacker News
📱Edge AI
Preview
Report Post
Optimizing LLM inference on Amazon SageMaker AI with BentoML’s LLM- Optimizer
aws.amazon.com·3d
🏗️AI Infrastructure
Preview
Report Post
How to build agentic AI when your data can’t leave the network
blog.logrocket.com·4d
🏠Self-hosted AI
Preview
Report Post
What Deep Learning Theory Teaches Us About AI Memory
dev.to·1d·
Discuss: DEV
🧠Memory Models
Preview
Report Post
How to Build AI-Based Recommendation Systems in Mobile Apps (2026 Guide)
vibe.forem.com·1d·
Discuss: DEV
🧠AI
Preview
Report Post